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ABSTRACT 

To explore the potential relationships among general 
attitude toward school^ evaluative ratings of courses and 
instructors^ and selected respondent characteristics^ an attitude 
inventory^ andr for each class, a course and instructor rating scale, 
with items which emphasized the nature of student-teacher interaction 
and level of course difficulty, were administered to 436 students in 
grades seven through twelve. Significant correlations suggest the 
need to adjust teacher rating results to account for student 
attitude, opinions about course difficulty and other dispositional 
variables. Further development of score-adjustment procedures and 
research to identify other relevant variables are also indicated. 
Information regarding the factor structures of the instruments is 
provided. The two instruments used in the study. Attitude Toward 
School and Course and Instructor Rating Scale, are included. 
(Author/BH) 
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ABSTRACT 



To explore the potential relationships among general attitude toward 
school, evaluative ratings of courses and instructors and selected respon- 
dent characteristics, an attitude inventory, and, for each class, a course 
and instructor ra i scale, with items which emphasized the nature of 
student -teacher interaction and level of course difficulty, were administered 
to 436 students in grades seven through twelve. Significant correlations 
suggest the need to adjust teacher rating results to account for student 
attitude, opinions about course difficulty and other dispositional vari- 
ables. Further development of score-adjustment procedures and research to 
identify other relevant variables are also indicated. Information regard- 
ing the factor structures of the instruments is provided. 



The purpose of this study was to explore the relationships among the 
general attitude of secondary students toward school, their ratings of courses 
and instructors and selected respondent characteristics. The utilization of 
teacher ratings for evaluative purposes is far from an exact science, pri- 
marily because of the relative recency of effort, the inherent problems and 
multifaceted nature of the task. Scott (1975) emphasized the increasing 
importance of addressing the validity of student ratings as the desire for 
their use as evaluative instruments increases. An analysis of 22 instruments 
used for instructor evaluation (Widlak, et. al., 1973) indicated a certain 
commonality of factor structure, with all instruments providing the factors 
of actor, i. e., presenter, interactor and perhaps also director. Pohlmann 
(1975) reported significant relationships between class characteristic vari- 
ables, such as expected grade and whether the course was required or elective, 
and student ratings in terms of both instructor presentation and interaction 
as well as course difficulty variables. The majority of these and other such 
studies are at the college level, with a lack of investigation related to 
teacher evaluation by students at the secondary level. However, Rosenshine 
(1973), in analyzing the effect of teacher behavior on students* attitude 
toward school, found significant positive correlations between attitude of 
sixth grade students and colleague ratings of teacher behavior in terms of 
such interaction variables as acceptance of student feelings, praise and use 
of student ideas. The present study examined correlations among (1) students* 
attitudes toward school, (2) their evaluation of instructors on a rating scale 
that primarily emphasized teacher interactive behavior, (3) course difficulty 
ratings and (4) class characteristic items similar to Pohlmann* s. As an 



investigation of correlates of student ratings seeking to identify biasing 
factors, Crittenden and Norr (1975) would categorize this study as a conver- 
gent and discriminant approach to validity, as opposed to studies concerned 
with reliability or relating ratings with achievement. 

Method 

Subjects. Respondents included 436 students in grades seven through twelve 
at the Florida State University Developmental Research School. 

Instruments and Procedures . Two questionnaires were administered to the stu- 
dents. The first. Attitude Toward School (ATT), was administered to all stu- 
dents in their English classes approximately two months prior to the end of 
the school year. The ATT is composed of 51 self-rating items to be marked on 
a five point scale from "rarely" to "almost always true" (see Appendix A) . 
The ATT is directed toward students* interest in school work, opinions re- 
garding teachers and school activities and procedures, behavioral responses 
to school tasks, and orientation toward relevant personality characteristics, 
such as ambition. The ATT was developed from 102 items selected from Khan's 
(1966) research instrument which incoirporated items from Brown-Holtzman (1956), 
Oaild, Frank and Storm (1956), and Smith (1972). Smith converted items from 
Khan's instrument, which was written for high school or college students, to 
a reading level judged appropriate for elementary and high school students. 

Factor analysis procedures were applied to Ss's responses. To determine 

the appropriate-nuniber- of- factors i a-series-of-analyses- were^-conducted' begin- — 

_ning with a principal factoring solution with communality estimates in the 
diagonal, followed by varimax rotation. A five factor oblique solution pro- 
vided the final structure. Programs within the Statistical Package for the 
Social Sciences were utilized in the analyses. 



Factor I indicated, for the student scoring high on this factor, anxiety 
and lack of concentration, retention, organization and comprehension where 
school tasks are concerned, with an accompanying lack of motivation or interest. 
For factor II a high score would indicate favorable regard for teachers as 
presenters and facilitators. Lack of interest, effort, ambition and response 
to achievement rewards, i. e., generally failing to perceive school as beneficial 
characterized factor III. Factor IV indicated a positive attitude toward 
teacher interactive behaviors. Avoidance o£ school tasks described factor V. 
Table 1 provides the items, their loadings, communality estimates, means and ) 
standard deviations. Subsequent to factor analysis, item responses were re- ^ 
versed as needed to provide uniform direction on a one to five scale. The 51 
item scores were then summed to produce a general attitude score with high 
scores reflecting favorable attitudes. 

Insert Table 1 Here 

The second instrument. Course and Instructor Rating Scale (CIRS), was 
derived from a student questionnaire developed by Sanders and Lynch (1973) 
in a study which analyzed discrepancies between perceived and ideal condi- 
tions (see Appendix B). The CIRS was administered in the last month of school 
and included 31 items, each scored on a 1-5 scale. Responses to 11 items were 
summed to produce an instructor rating (RATE) score, with a high score in- 
dicating a favorable rating. These items dealt with instructor-pupil inter- 
action and such things as whether the in^ructor praised good work, 
helped students feel better about themselves, treated students fairly, encour- 
aged students to develop their own interests and adjusted subject matter to 
the interests and ideas of the students. Of the remaining items, seven per- 
stained to workload and testing. These were combined to produce a course 
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difficulty (DIFF) score, with a high score indicating relative ease. Decisions 
regarding the items to be included in RATE and DIFF scores were made on a priori, 
face validity basis taking into consideration prior research and development 
efforts and led to the decision to exclude seven items. 

Factor analysis of Ss" responses, utilizing aggregated mean responses 
for each item for each £ and the same procedures as with ATT, generally sup- 
ported the validity of these decisions. Table 2 provides the items, their 
loadings, communality estimates, means and standard deviations. As indicated, 
three factors were derived. Factor I contained seven of the 11 RATE items and 
two unscored items. This factor can readily be considered as an evaluation of 
the instructor's interactive behaviors. Factor II contained four DIFF items, 
one RATE item and three unscored items, all of which involved evaluation of 
course activities and requirements, e. g., frequency of testing and amount of 
assignments. Factor III contained three DIFF and two RATE items pertaining to 
the amoiant of challenge or generic demand that the course provided in terms of 
amount of work, pace and intellectual stimulation. In many ways this factor 
can be viewed as representing the overlap between teacher stimulation and course 
difficulty, i. e. , the area in which the two become integral for evaluation 
purposes. Such a view is supported by the representation of both RATE and DIFF 
items and would suggest the likelihood of obtaining a substantial relationship 
between RATE and DIFF. One RATE and three unscored items did not appear in 
any of the factors. 

In addition to the 11 RATE, seven DIFF and seven excluded five -point 
Likert-type items, responses to four class characteristic (OlAR) items were 
gathered for the purpose of examining their individual and collective relation- 
ship with ATT, RATE and DIFF scores. These items solicited indications of the 
Student's expected grade, enjoyment of subject, whether the course had been '^/M:; 



reconunended by a peer and whether it was required for graduation. An addi- 
tional two class characteristic items completed the scale but were not of 
interest in the present study. 

Insert Table 2 Here 

Students were requested to provide their student indent if icat ion numbers 
when completing both scales and were assured anonymity. CIRS was not adminis- 
tered by the instructor being rated. Instead, instructors traded classes for 
the first part of a given period and followed a standard procedure for admin- 
istration. Classes selected to complete CIRS included those of teachers who 
voluntarily chose to have the scale administered, approximately 87 percent 
CN=33) of the secondary level faculty. For students failing to provide an 
identification number when completing either of the scales, data were, of 
necessity, eliminated from subsequent analyses. No follow-up testing was con- 
ducted to include absentees. Thus, the resultant N of 436 different respon- 
dents represented 81 percent of the student body. 

Results 

Initial analyses were primarily for the purpose of providing instructor 
feedback. The ATT and RATE scores were computed for each student by class 
with the mean and standard deviation of each variable for each class, as well 
as the correlation between these variables provided to the instructor. These 
results were also aggregated to produce means and correlations representing 
the combined classes of each teacher. Finally, these results were further 
aggregated to provide the same set of indices for each content area. Figure 
1 graphically portrays each level of aggregation and Tables 3 and 4 include 
the latter two levels of composite data. 



12 



V) 

tc 

nJ O 

fH ti to 
'r? JL 



0) 


. 


rH 


^ CO 


cd 


iS 


o 




CO 


5 


Cd H-l 






CO o. 


•H 


•H 




^ 4J 


cd 


C CO 




Cd 'H 






u 


CO 0) 


o 


s *^ 




cd o 


o 


« cd 




= S 


g 








CO 


CO o 




0) 




•H (/) 




4J CO 




•H cd 




•H iH 




Cd U 






0) 


s ^ 


CO 


§ c 








o 


§ 


u 3 


u 










2 X 




c w 




•H 




(L. 














1 









6 • 

*^ CO 



6 C 
0) cd 

4-> 0) 



o cd 



o cd 
cd o 



0) 

(O 

c 

O (O 

CO i-H 

« O 

0^ cu 



•-H to 



00 



to 



§ 

•H 

a 
cd 
u 

0) 



u 








§1 






O 








O 











CO 

. 8 
0) 
4-> 



1 



o 

00 



\0 
vO 



VO 



to 



00 



o 



o 



to 























iH 


Cd 




0) 




0) 






:i u 




Cd 








0) > 


U 




M 0) 


0) 


o 


CM C 


> 





CO 

cd 0) 

> > 

i-H 0) 

Cd C 







CO 




rH 


4-> 


CO 




0) 


O 


cd 


CO • 


0) 


0) 






CM 




O 










0) o 


CO 


•§ 


0) 






CO pC 








4-> 




0) 


0) 




CO 0) 








"3 

4-> • 


♦J 


O 




CO CO 




(0 




0) 


•s 




cd O 


> 


4-> 


CO 


H 






0) 




P4 d> 








I-H CO 








H 


•3 


.s 


C 0) 












U 






O 


O 


























gs- 




1 


o 




Cd 








CO 


CO 




CO O 


•H 0) 


5 




.5 ^ 










0) 4-> 






o 




1 
















to 






M 


CM 




CM 



CO 

cd 0) 

> > 

Cd C 



O 

•g 

CO 
•H 

Cd 
u 

Q 



4-> 
CO 



0) 



CM 



CO 

g « 

Cd C 



CO 

>s u 

cd 0) 

cd C 



CO 

cd 0) 
cd C 



u 

•H 

Cd 

•s 

Cd 

0) 
O 



K> 
CM 








to 


CM 




O 
















o 




CM 














• 


• 


CM 


CM 


CM 


CM 




CM 


CM 


CM 



to 







O 


Oi 


to 




CM 


o 


00 








to 


to 


to 




1 


1 


1 


1 


1 


1 


• 


• 



I U 'H 

0) > CO 

4J 0) 

C ^ M 

•H bO 0) 

0) CO e 

> 0) 9 



CO 



•8 

a 



to 



ERIC 



13 



(0 

bO 



•J 

o o 

p <J vO 
cd rt to 

> JL 
0) 0) ^ 

rH Q W 

Cd 

CO fH • 

cd V) 
bOT3 6 
C C 0) 

cd ♦J 

4J l-H 

5" o 

b S 

O cd V) 

CO fH 

gq a> 
cd 4J 

4-1 a> a 

(0 SI c<) 

^ cd 

CO ^ 
^ 0) O 

§ *^ CO 
•H CO 
0) rH cd 

CO Cd 7^ 
5 i M 

u i c 

O *ri 
rH rH 

^ Cd q 

CM 

0) 
rH 



0) o 

-H CO 



6 



23 



0) 
CO 

§ CO 
0) 

CO rH 
0) O 



§ § 

-H CO 



to 



ro 



Cd iH 

0) cd 

> > 



^ CO 
CO 

•H 0) 

M o 
§ u 

C0 pC CO 

o 00 

C *H (0 

c3 5 
o bO 

0) 

^ ^ S 

CO 4^ 



Ok 



00 



o 



to 



00 



CO 

cd 0)^ 
cd c 



10 
0) 



10 



•H 

u 
o< 

CO 
I 
I 



o 
o 



(3 bO 
•H C 
•rl 

0) Cd 

O 0) 

ll 

4^ » 

10 

C 

•H 

Cd 

2 ti 



4-> 



i 



00 



to 



t 4J 0) 

0) O .4-» 

^ ^ o 

5s C 5s 

M 0) M 

0) s a> 

> 5'> 



CO 

cd 



s 
g 

u 

0) 
CO 



4-» 
bO 



0) 



SO 



O 

SO 



CM 



to 



0) iH 
bOrH 



2 o 
o o 



so 



so 



CM 



^ bO 



O 4-i 
O O 
4-i C 



01 



to 



CM 



to 



0) iH 

bo cd 



5g gs 



01 



0) 




10 



ERLC 



14 



4^ cd a 

g.55 



0) O 
4-* • 



O cd 



S.S 

o cd 
cd O 
pu ,-3 



0) 

O V) 
0) 

(A i-H 

'OS a. 



8 S 

0) 0) 

-i CO 



0) e 



o 

(0 



r4 

00 



to 
to 



to 
ro 



to 



cd f-H 

he V) 
^1 U 

> > 



V) 

Cd 

0) 



Cd 
:) 

•H Cd 



I 

O 



0) 

(A 

8 



a> *S 

^3 



to 



00 



to 



CM 

to 



to 



to 

CM 



to 

to 



U 

0) 

4S > 
^ dO 0) 

o o ^ 

CO 

O 4^ » 
O O i-H 
4^ C Cd 



o 



i 

(0 



0) 



O M 

•H C 
•H 

O cd 
too 1-4 

^ & 

O 0) 

c 

•h| 

O rH 
4^ 

Cd 



0) 
too 

c 

0) 



cd 



cd 

0) 



I 



8 " 



O 
vO 



CM 



to 
to 



CM 

to 



(A 



CA 
0) 

2 > 

C 1-4 

O 0) 
•H CO 

u 

4-i 4-i 
•H 

•H C 

4-» M 
U 4^ 

5S 
5t! 
^1 



00 



vO 
iH 

CM 



NO 



vO 



(0 

r 



cd 

JG 
O 

0) 
tA 



0) CA 

4-' C 
O 

It; 

4-i ,e 



4-t 
CA OO 



CM 



CM 
CM 



to 
to 



to 

vO 



U 

> 



to 



to 

CM 



o 
to 



CM 

to 



(A O 

Cd i-H 

<M CA 

> > 




to 



s 



in 



CM 



ERIC 



15 



I 



0) o 



6 C 

l-H :S 



4-> 



O cd 



O cd 
cd a 



o 

6 
O V) 
0) 

(O l-H 

q O 
c4 cu 



l-H C/3 



00 



o 

00 



CM 



cd cd 
0) B 

&^ 

0) 

FH .H 
0) 9 

> o- 



co 

•H 
•H 



16 



ERIC 



6 



Insert Figure 1 and Tables 3 and 4 Here 



As indicated, significant relationships were obtained for seven of the 
11 content areas and for 14 of the 33 teachers. The range of correlations 
for both tables can be summarized as -.09 to .54, with 75 percent falling be- 
tween .05 and .30. 

On the basis of these results the decision was made to pursue a more 
comprehensive investigation of factors that influence teacher ratings by stu- 
dents. Item responses to CIRS were aggregated across classes to produce a 
single set of mean responses to the 31 items for each and these data pro- 
vided the basis for the previously presented factor analysis. Figure 2 por- 
trays the nature of this aggregation. The maximum number of CIRS completed 
by an individual student was eight, with 3.77 representing the mean. Means 
and standard deviations for ATT, RATE and DIFF, with data aggregated in this 
fashion, together with zero-order correlations among these and the selected 
CHAR variables, are provided in Table 5. 



As indicated, 13 of the 21 relationships were significant in the expected 
directions* All relationships among the scored variables, i.. e., ATT, RATE, 
DIFF, were significant. DIFF was not significantly related to any of the CHAR 
variables and whether the course was required was not related to any of the 
scored variables. However, the remaining CHAR items were correlated with ATT 
and RATE, with enjoyment of subject providing the strongest relationships. 

To validate the a priori selection of items comprising RATE and DIFF, 
as well as clarify the observed correlations among the three scored variables, 
factor scores were generated for both ATT and CIRS with QlAR items excdu^MT 



Insert Figure 2 and Table 5 Here 
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Table 3. Correlations, Means and Standard Deviations 
for the Attitude Toward School (ATT) and Instructor Rating Score (RATE) 
of the Course and Instructor Rating Scale (CIRS) 
by Content Areas for 





7th Through 


12th Grade Students.* 






Content 










ATT 


_ RATE 




Areas 


N 


r 


P 


jT 


S.D. 


X 


S.D. 


Math 


328 


.13 


.011 


179 


28.8 


40.6 


6.6 


Science 


268 


.24 


<.001 


179 


30.0 


39 '.5 


7.5 


English 


260 


.07 


.127 


181 


28.8 


40.9 


6.7 


Social Studies 


321 


.19 


<.001 


177 


29.0 


37.4 


7.4 


Physical Education 


101 


.13 


.098 


185 


29.2 


41.; 


7.2 


Foreign Language 


204 


.23 


<.001 


184 


27.1 


41.1 


6.9 


Music 


372 


.12 


.009 


178 


30.7 


38.4 


7.8 


Industrial Arts 


71 


.23 


.026 


169 


21.4 


36.4 


7.1 


Home Economics 


66 


.33 


.003 


175 


27.3 


39.3 


6.2 


Art 


34 


.15 


.205 


172 


32.7 


38.5 


8.8 


Business 


59 


.01 


.469 


176 


34.5 


39.6 


6.4 



Table 4. Correlations^ Means, Standard Deviations 
for the Attitude Toward School (ATT) and Instructor Rating Score (RATE) 
of the Course and Instructor Rating Scale C^^IRS) 
by Teacher for 7th Through 12th Grade Students. * 
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Music 


27 
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Industrial 
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169 
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Table S. Means and Standard Deviations of Scored Variables and 
Correlations Among Scored and Class Characteristic Variables.* (N=436) 



Course Enjoy Course 
ATT RATE DIFF Required Subject Recommended 

RATE .30 
<.001 

DIFF .09 -.22 

.024 <.001 



Course 


-.07 


.02 


.03 








Required 


.068 


.350 


.259 








Enjoy 


-.26 


-.41 


.01 


.27 






Subject 


< .001 


<.001 


.383 


<.001 






Course 


-.12 


-.11 


.06 


.21 


.39 




Recommended 


.005 


. .011 


.109 


<.001 


<.001 




Expected 


-.20 


-.15 


-.01 


.06 


.115 


.04 


Grade 


< .001 


<.001 


-.396 


.113 


<.001 


.200 


Mean 


177.63 


39.53 


16.85 








S.D. 


28.04 


4.50 


2.67 








Possible 


55-255 


11-55 


7-35 









Range 



* Probabilities appear below correlation coefficients and are one-tailed; 
^=.05. Indicated directions of these correlations must be carefully 
considered in conjunction with direction of scoring and results of factor 
analyses. 



A principal component solution, i. e., unity in the diagonals, which specified 
the number of factors considered appropriate by the previous factor analysis,, 
was used. The a priori scored variables were then correlated with the factor 
scores. The results are presented in Table 6. 

Insert Table 6 Here 

The -.89 correlation between RATE and the teacher interaction factor of 
CIRS, as well as the correlation of .93 between DIFF and the combined difficulty 
factors, as seen in Table 6, strongly support the original assignment of scored 
items. The negative correlation results from the reversal of RATE items for 
scoring purposes. Interestingly, favorable ATT and RATE scores were associated 
with relative lack of difficulty in terms of specific course activities, as 
may be expected, but were conversely associated with presence of difficulty in 
terms of challenge and stimulation. 

The ATT factors are, of necessity, strongly related to ATT score, since 
this score represents a linear combination of all scale items. ATT factor II, 
which involves general attitude regarding teachers as presenters and facilita- 
tors, bears the most consistent and strongest relationships with the other 
variables presented, lacking relationship only with CIRS factor III, overall 
challenge. These relationships indicate that students with favorable attitudes 
toward teachers in general tended to provide favorable ratings for their teach- 
ers and not view courses as difficult in terms of specific activities required. 
ATT factor V, avoidance of school tasks, is significantly related only to the 
two teacher rating variables such that those who avoid school tend to rate 
their teachers unfavorably. ATT factors I and IV indicate scant, though occa- 
sionally significant relationships. There is some indication that Ss who scored 
high on ATT factor IV, indicating favorably regard for teachers as interactors. 



Table 6. Correlations Among Scored Variables, Individual 
Factor Scores and Selected Combinations.* CN=436) 



CIRS Factors** ATT Factors 







T 
• 1 


T T 


T T T 
111 


T J. T T T 
1 + 111 


T T T T T 
11-111 


T 
1 


T T 
11 


T T T 
111 


IV 


V 




ATT 


-.23 


.25 


.10 


.23 


.10 


-.49 


.37 


-.48 


.50 


-.38 






<. UUl 


\« UUl 


. U/U 


<. UUl 


nOn 
.UiiU 


<.UU1 


<.UU1 


<.UU1 


s.OOl 


<.001 


Scored 


RATE 


-.89 


.11 


.34 


.87 


-.16 


-.05 


.25 


-.16 


.08 


-.16 


Variables 




<.001 


.010 


<. 001 


<.001 


<.00l 


.133 


<.001 


<.001 


.047 


<.001 




DIFF ■ 


.06 


.66 


-.67 


-.51 


.93 


-.02 


.15 


.03 


.07 


-.01 






.106 


<.001 


<.001 


<.001 


<.001 


.352 


<.001 


.242 


.059 


.414 




I 












.02 


-.24 


.06 


-.06 


.20 






t 










.357 


<.001 


.097 


.097 


<.001 


CIRS 


II 












-.07 


.25 


-.16 


.08 


0.00 


Factors 














.067 


<.001 


<.001 


.047 


.500 




III 












-.04 


0.00 


-.20 


-.02? 


..03 
















.181 


.500 


<.001 


.350 


.295 



* Probabilities appear below correlation coefficients and are one-tailed; 
oC = .05. Indicated directions of these correlations must be carefully 
considered in conjunction with direction of scoring and results of factor 
analyses . 



** Excluding CHAR items. 



8 

tended to provide favorable specific ratings of their teachers, and not view 
their courses as difficult in terms of required activities. These relation- 
ships are thus consistent with, but not as strong as those obtained with ATT 
factor II. Students scoring high on ATT factor III, indicating a failure to 
perceive the benefits of school, tended to score low on CIRS factor III, in- 
dicating lack of overall challenge in their courses, and to also score low on 
CIRS factor II, indicating relative difficulty in terms of course activities. 

Because course difficulty in terms of overall challenge was viewed as 
an integration of both teacher and course ratings, CIRS factors I and III were 
combined and correlated with the scored variables. The magnitude of the re- 
sulting relationships are analogous to those of factor I alone, except, of 
course, with DIFF, where a sizable correlation increase was inevitable since 
CIRS factor III contains primarily DIFF items. 

Canonical correlations among the respective items of ATT, RATE, DIFF 
and aiAR were also calculated to determine maximum obtainable correlations 

given optimally weighted, linearly combined item responses. These results 

I, 

are provided in Table 7. 

Insert Table 7 Here 

These results indicate that there is at least one meaningful and signi- 
ficant relationship obtainable for each possible pair of item sets. For the 
relationship between ATT and RATE there are three unique sets of item coeffi- 
cients which, when utilized in the linear combination of respective items, 
produce significant and meaningful correlation coefficients. For the pre- 
sented relationships involving CHAR items, expected grade and enjoyment of 
subject separately indicated strongest weights. Expected jgrade predominantly 
defined the item set for the relationship with DIFF and in thj^ first root with 

25- . " ■ ; i 



Table 7. Significant Canonical Correlations 
Among Item Sets.* CN=436) 





ATT/ 


ATT/ 


ATT/ 


RATE/ 


RATE/ 


DIFF/ 


ATT, DIFF, 




RATE 


DIFF 


CHAR 


DIFF 


CHAR 


CHAR 


CHAR/ RATE 




.538 • 


.446' 


.509 


.546 


.529 


.470 


.707 


I X2 


783 


412 


306 


303 


182 


128 


1184 


df 


561 


357 


204 


77 


44 


28 


682 


P 


<.O01 


.023 


<.O01 


<.001 


<.001 


COOl 


<.001 







coo 


. 422 


.370 


.615 


II 




645 


183 


152 


908 




df 


500 


150 


60 


610 




P 


COOl 


.031 


<.001 


<.001 






.479 






.558 


III 




516 






718 




df 


441 






540 




P 


.007 






<.001 




\ 








.518 


IV 










570 




df 








472 




P 








<.O01 



* Reported are correlations that are significant (^=.05) and exceed .30. 



ATT, while enjoyment of subject defined the second root and the relationship 
with RATE, The correlation of .707 between the set of RATE items and the 
items of ATT, DIFF and CHAR considered collectively, indicates that about 50 
percent of RATE variance can be accounted for by the combined set of other 
variables, or vice-versa. The item with the largest weight by far was enjoy- 
ment of subject « 

Discussion 

The results indicate that the attitudes of students toward school and 
teachers, as well as their specific opinions regarding course difficulty, their 
enjoyment of the subject and the grade they expect to receive, are strongly 
related to their ratings of teachers. It is also evident, however, that 
teacher ratings are to a substantial degree distinct from the other variables. 
Such a finding contributes some understanding to the credibility of teacher 
ratings by students. Variables such as those investigated, which collectively 
may be said to constitute a predisposition or evaluative set, appear to distort 
the valid component of teacher ratings. This would suggest the need to account 
for such an effect in the interpretation and utilization of teacher rating data, 
whether for purposes of feedback or for improving decisions related to compe- 
tency, promotion or tenure. One approach would be the development of measures 
which do not confound variables, though it is likely that success in this regard 
would be limited. Alternatively, an appropriate total score on a teacher rating 
scale would include adjustments for the effects of predisposition. The wide 
range of correlations obtained across classes and content areas between RATE 
and ATT, as indicated in Tables 3 and 4, suggests that such adjustments should 
be on the basis of accumulated influences of individual students and specific 
to individual teachers and/or classes. One possible method of adjustment would 
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be to generate canonical variate scores for each student based on the complete 
set of items considered to be independent variables. These scores could then 
be utilized as coefficients for each student's dependent variable, i. e. , 
teacher rating score. The mean of these adjusted scores would constitute the 
evaluation index. 

In addition to the variables investigated, there are perhaps other vari- 
ables exerting separate influences in similar fashion. Also, it should be 
emphasized that RATE items primarily focused upon interactive aspects of the 
teaching role. It therefore would be inqportant to extend to other areas, e. g. 
teacher as presenter and director. Such variables should be the target for 
future research. 

As a potential qualification to the external validity of these findings, 
it should be considered that the sample of laboratory school students probably 
represents, in terms of attitude, a narrower range and a group that is somewhat 
more favorably disposed than would be the case in many public school settings. 
It is unlikely that a substantially different pattern of relationships would 
emerge, though it is possible that the magnitude of relationships would in- 
crease as a result of removal of restriction of range. 

In summary, the significant correlations obtained among the various dis- 
positional variables and the teacher rating indices indicate the need (1) to 
incorporate the influence of such variables in the utilization of teacher rat- 
ing data, (2) to conduct further research to identify other relevant variables, 
(3) establish appropriate score-adjustment procedures and (4) cross-validate 
present findings. 
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Attitude Toward School 

In this survey are some sentences which will give you an opportunity to 
tell how you feel about school and about the way you study. Your answers will 
be treated with the strictest confidence, so please answer exactly the way you 
feel. There are no right or wrong answers. 

You wilt mark you answers on a separate answer sheet. Hake no marks on 
this booklet. After reading each sentence, decide how you feel about it and 
mark you answer on the answer sheet with a number 2 lead pencil 

If you feel that the statement is rarel y true 

for you. blacken the first s^ace 

( Rarely means from 0 to IS percent of the time) 

If you feel that the statement is somet imes 

true for you, blacken the second space 

( Somet imes m eans from 16 to 35 percent of the time) 

If you feel that the statement is frequently 
true for you, blacken the third space 
( Frequently means from 36 to 65 per cent of the time) 

)f you feel that the statement is generally 

trv: for you, blacken the fourth space 

(Generally means from 66 to 88 per cent of the time) 

If you feel that the statement is almost 

always true for you, blacken the fifth space 

( Almost always means from 86 to 100 per cent of the time) 



Work as rapidly as you can without being careless. Please answer every Item. 



1. I feel that teachers understand the needs and interests of students. 

2. My teachers make their subjects Interesting and meaningful to me. 

3. Whether I Hke a subject or not, I still work hard to make a good grade. 

k. When my assigned homework is e;^tra long or unusually hard, I quit or study 
only the easier parts of the lesson. 

5. My teachers say my written reports are hurriedly written or poorly planned. 

6. I feel that teachers do not allow their likes or dislikes for students to 
influence their grading too much. 

7. I think that teachers like to show who's boss too much. 

8. I lose interest In my studies after the first few days each year. 

9. I give special attention to neatness on themes, reports, and other work to 
be turned in. 

10. Lack of interest in my school work makes It hard for me to keep my attention 
on reading. 

11. Unless I really like a subject, I believe In doing only enough to get a 
passing grade. 

12. I get -nervous and confused when taking a test and fail to answer questions 
as wel 1 as I could. 

13. When explaining a lesson or answering questions, my teachers use words that 
I do not understand. 

I'l. When I get behind In my school work for something I can't help,,! make up 

lessons without being reminded by the teacher. | 

15. Daydreaming keeps me from paylhg attention while I am studying. 

16. I feel that teachers are overbearing and conceited in deal Ing with students.^^^;^ 

17. I believe that teachers secretly enjoy giving thel r students a ''hard time^^^ 

18. I think that teachers usually talk too much. 



19. When I am having trouble with my school work, I try to talk it over<w|^^^^ 

teacher. ... V / , o/;-';;>J-{V:^i"^^^tj| 



20. I feel that teachers try to give the same amount of; a ttent and help ta^ 
their students. "'^ , .^'i^-^;— ■ - -^ :M -^^i;-^^^ 
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21. The illustrations, examples, and explanations given by my teachers are 
Interesting and easy to understand. 

22. I feel that teachers tend to be rude to their poorer students and make fun 
of their mistakes. 

23. I feel that my grades show what I can really do. 

24. Because I find it hard to think clearly and plan my work within a short time, 
I do poorly on tests. 

23. Some of my classes are so boring that I spend the class period drawing 

pictures, writing notes, or daydreaming Instead of listening to the teacher. 

26. I am unable to study well because I get restless, moody, and have the blues. 

27. I put off doing my written work until the last minute. 

28. I feel that I am taking subjects which will do me little good. 

29. I feel that teachers make their subjects too hard to most students. 

30. I try to be really interested in every subject I take. 

31. I think that it might be best for me to drop out of school and get a Job. 

32. I skip over the figures, graphs, and tables In a reading assignment. 

33. After reading several pages of an assignment, I am unable to remember what 1 
have Just read. 

7 34. I feel like skipping school whenever there is something Md rather do. 

35. I think that students who ask questions and take part In class discussion are 
only trying to ''get in good" with the teacher. 

36. I waste too much time talking, watch;9ig TV, listening to the radio, going to i:; 
the movies, etc., for the good of my studies. 

37. I believe that teachers give tests on purpose on the days fol lowing part les . 
and ball games. : 'fl 

38. I complete my homework assignments on time. 

39. I find it hard to pick out the important points of a reading assignment that |J 
may later be asked on a test. 

40. When reading a long assignment, I stop now and then to try to remember what i^^^^^ 
i have read. 

. .1' ' • ■ ■• '•■''^■^-W^iM 

• ■■ ■ ■■ ■ • ' , • • ' ; ' ■ y^>^\^4s^'0^ 

... ' •■ • '^S 
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^1. With me, studying is sort of hit-or-mis$ depending on the mood I 'jn in. 

^2. I Iceep my assignment up to date by doing my woric regularly from day to day, 

43. I am careless of spelling and the rules of English when answering test 
quest ions. 

If time is left, I talce a few minutes to checic over my answers before turning 
in my test paper. 

^5. I feel that students can be expected to I lice most teachers. 

^6. At the beginning of a study period I plan my worIc so that I will use the time 
best. 

^♦7. I dislike the discipline required for successfully accomplishing some difficult 
taslc. 

48. Above all, I want to have an outstandingly successful career. 

49. I feel that much of life's enjoyment is lost because we are taught that it is 
so important to get ahead In life. 

50. Ambition drives me to over greater efforts. 

51. I feel that in our schools too much stress is put on achievement. 
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Course and Instructor Rating; Scale 
Grades 7-12 

DIRECTIO^IS: There are no rip:ht or wronn; resoonses to these 
statements. Record your reactions for each statement on 
your answer sheet. Do not write on the booklet. Describe 
your reactions to each statement as best vou can bv markinrr 
one of the five letters A, B, C, or E. ^or example, for • 
Item 1 if vou think the amount of work you did in this course 
was very n;reat > record the letter A; if vou think the amount 
of work you did in this course was quite small , record the 
letter E; if you think the amount of work you did in this 
course was moderate , record the letter C. If you feel the 
rating should be placed between one of these categories, please 
indicate by respondinjy to categories B or D. 

IMPORTANT I Do not write your name on the answer sheet or make 
any marks on this rating scale. Please record your four digit 
identification number, in the boxes at the lower right hand 
corner of your answer sheet, '^rid the appropriate spaces below 
each box by makin<^ a heavv mark with vour pencil. Be certain 
to use a nunjber 2 pencil. Mow write the instructor's name. 
Course name ^ and date of administration in the spaces provided 
at the top of your answer sheet. 



1. The amount of work I did for 
this course was 



verv nuite 

n;reat A B'^ "C D E small 



Opportunities to enter into 
class discussion were 



verv quite 

o;reat A B (T D E small 



The instructor provided 
situations for students to 
think for themselves 



alwavs 



never 



A B C D E 



The instructor v;ent into too 
much detail v/hen explainin<7 
material 



always 



never 



A B C D E 



5. The instructor demanded a lot 
of work from his students 



alwavs 



never 



A B C n E 



The instructor mr-ide the course 
challen.fjinp; to his students 



alwavs 



never 



A B C D E 



The instructor disDlayed a 
sense of humor 



always 



never 



A R C T) E 



8. The instructor took time to 
help students in class 



alwavs 



never 



A B C D E 



9* The amount of readinc^ assir^ned 
by the instructor for this 
class was 



too 



not 



much A B C ^ E enou«;h 



10. The instructor locturcd 



too 



not 



much A B C n E enough 



11. The instructor did not 0:0 
into enou;?h details when 
exDlainin<y material 



always never 

A B~^C " 13 F 



12. The pace (assirjnment , work, 
and discussions) of the 
course was 



verv 



very 



fast A B C D E slow 



EKLC 
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13 • The course content was 



verv 



very un- 



interestincr A B C D E interestin<5 



Testing of the course 
content was 



verv 



not verv 



frequent A B C 0 E often 



15. The amount of reference ma- 
terials (handouts , texts 
reserved books , etc . ) ^/as 



verv ouite 

lar<re ^ R C"*n E small 



16. The number of hand--.in 
assif^nments was 



too too 

larqe S~ B C ^5 F small 



17. The amount of teacher direc- 
tion for this class was 



verv 

^?reat A B C n 



very 

K small 



18. The number of audiovisual 

materia2,s used in the course 
was 



19. The amount of information 

orovided students re<;ardin«^ 
their nro<^ress during? the 
course was 



very 



verv 



threat ABODE small 



very 



verv 



♦Treat A B C D E small 



20. The students wasted time 
in this class 



21* The instructor praised '^ood 
work 



22. The instructor helped students 
feel better about themselves 



very 



lot ABODE little 
al'^avs 



A B C n E 

freouentlv 

A B C D E 



never 



never 



23. The instructor treated me 
fairly 



always 



A^B C D E 



never/;'. 



2^. The instructor encouratjed 

students to develop interests 
of their own 



always 



A D~E 



. . . • •'.■S.'-V/ilJ'i^' 



25. The instructor adjusted the 
subject matter to the in- 
terests of the class 



very 

well A B C D E all 



Record your anst;ers to each of the followin^r six items in the 
appropriate soace on vour answer sheet. 



26. V/ere you required to take this course for f^raduation re- 



quirements? 



(\) ves 



(B) no 



21. 



Do you enjoy this 



subject? 



(A) yes 



(B) no 



28. 



Was this course recommended to vou bv another student? 



(A) yes 



(B) no 



29. Since you have been in seventh ";.rade , hov; manv courses have 
you had in this subject area? (Consider a course to be one 
semester in len.f;th. ) 

(A) none (B) 1-2 (C) 3-4 (t^) 5-6 (E) 7 or more 

30. How would you estimate your fTrade-point-averan;e for all vour 
subjects this semester? 

(A) Excellent (B) Above averan;e (C) Avera<3[e 

(D) Below avera<;e (E) Poor 

31. What grade do vou expect to receive in this course? 

(A) Excellent (B) Above averac^e (C) Avera.<;e 
(D) Be lo\7 average (E) Poor 
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